?ioo3zsr/kjo/j 




Europaisches Patentamt 
European Patent Office 
Office europ£en des brevets 




(vj) Publication number : 0 640 903 A1 



EUROPEAN PATENT APPLICATION 



(2?) Application number: 94306371.9 
(22) Date of filing : 30.08.94 



© int. ci. 6 : G05D 1/02, B62D 1/28 



(So) Priority : 28.08.93 GB 9317983 

@ Date of publication of application : 
01.03.95 Bulletin 95/09 

(S3) Designated Contracting States : 
DE ES FR GB IT 



ffh Applicant: LUCAS INDUSTRIES PUBLIC 
LIMITED COMPANY 
Brueton House, New Road 
Solihull, West Midlands B91 3TX (GB) 



(72) Inventor: Wilson-Jones, Russell 
6 Montgomery Close 
Stratford-upon-Avon, Warwickshire (GB) 
inventor: Tribe, Raglan Horatio Andrew 
Harold 

129 Longdon Road, 
Knowle 

Solihull, West Midlands B93 9HY (GB) 
Inventor : Appleyard, Michael 
31 Judeland 

Choriey, Lancashire PR7 1XJ (GB) 

(74) Representative : Spall, Christopher John et al 
BARKER, BRETTELL & DUNCAN 
138 Hagley Road 

Edgbaston Birmingham B16 9PW (GB) 



(54) A driver assistance system for a vehicle. 



(57) A video camera or equivalent sensor is moun- 
ted on a vehicle and used to detect the lane 
markings on the road (usually the white painted 
lines). An associated signal processor (11) esti- 
mates the vehicle's lateral position in relation to 
the lane markings. An electric motor (4) coupled 
to the steering mechanism (1) is used to provide 
a torque input to the steering which may either 
assist or oppose the steering torque from the 
driver. The processor (11) is designed to assist 
the driver to maintain the vehicle's lane position 
by holding the vehicle at a set-point using a 
biasing torque. This simulates the effect of the 
lane being cambered upwards towards the lane 
edges. However the driver is able to override or 
cancel the effect if the driver applied steering 
torque exceeds a prescribed torque threshold. 
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This invention relates generally to a driver assistance system for a vehicle adapted to control the direction 
of a moving vehicle along a predetermined path. 

A recent U.S. study shows that 25% of all road accidents are caused by unintended road or lane depar- 
tures. Mounting evidence suggests that many of the accidents are caused by drivers falling asleep, although 
5 it is difficult to prove, as many drivers will not admit to this. Automatic lane following systems have been dem- 
onstrated operating at motorway speeds, since 1985. Such systems certainly prevent lane departure while 
lane markings are present, but do not prevent drivers falling asleep. Indeed, there is a danger that a reduced 
driver workload could even encourage drowsiness. 

Presently drivers are required to maintain significant concentration and co-ordination to maintain a central 
10 position between lane markings, especially with variations of road camber, road curvature, and cross winds. 

EP-A-0 514 343 discloses an automatic lateral guidance control system for guiding moving vehicles. The 
system includes a sensing subsystem for viewing an area in front of a vehicle, a plurality of energy radiating 
or energy reflective devices disposed adjacent a predetermined length of road, an apparatus for translating 
the radiating or reflected information from the viewed area into co-ordinate data representing an approximation 
15 of the predetermined path along the road, and a vehicle controller for determining the vehicle's heading with 
respect to the approximated path and providing an output control signal to correct the vehicle's heading with 
respect to the approximated path. The system uses past and present position data to calculate a predetermined 
path for the vehicle. Gain factors and comfort factors are determined to maximise comfort for passengers of 
the system and to optimise performance of the system. The automatic guidance control system of EP-A-0 514 
20 343 is adapted to control the direction of a moving vehicle without the need for human intervention and the 
system is more responsive than the control provided by the operator of the vehicle. 

According to our invention a method of tracking a contrived centre line between lane markings of a road 
characterised in that a steering bias is applied to the steering system of the vehicle In such a manner as to 
assist the driver in tracking the contrived centre line position. 
25 The contrived centre line may be the true centre line between lane markings, for example on a motorway, 

or may be offset from the true centre line, for example to facilitate the negotiation of curves or bends when 
the contrived centre line comprises a more economical tracing a line. 

Conveniently the level of steering bias applied to the steering system is relatively small when the track of 
the vehicle is in proximity to the contrived centre line proximity and the steering bias is adapted to be increased 
30 as the vehicle approaches the boundaries defined by the lane markings. 

Conveniently a steering torque ripple is applied to the steering system as the vehicle approaches a lane 
boundary. In addition an audio signal may be produced to alert the driver of possible lane boundary infringe- 
ment. 

The audio signal may simulate that of a "rumble" strip crossing or that of crossing "cats eyes". 
35 The frequency of the audio signal may be proportional or varied in some way according to the velocity of 

the vehicle and may be arranged to be produced so as to appear from the area of infringement 

The conventional audio system of the vehicle may be utilised to produce the simulated infringement signal. 
In such a case the conventional audio system may be inhibited during infringement signal simulation or it may 
be blended with the conventional audio signal output 
40 If the lane marking signals are lost, a warning is issued to the driver and the system is disabled. Should 

the lane marking signals be lost due to masking of the signals by a preceding vehicle then the system adopts 
a vehicle tracking approach until the lane marking signal is re-established. 

This system incorporates means for cancelling the signal bias when a direction indicator of the vehicle is 
actuated. Preferably only that steering bias in the direction of indication is cancelled and steering bias is still 
45 applied in the opposite direction of movement of the vehicle with respect to the contrived centre line. 

The steering bias is adapted to be applied to the steering system by the use of an electrically operated 
device, such as an electric motor, which co-operates with the existing, conventional, steering system of the 
vehicle, which may be power assisted. 

The lane markings may be detected by the use of a video camera or equivalent sensor mounted on the 
so vehicle which is light sensitive" or of the "infra-red" sensing type. An associated signal processor estimates 
the lateral position of the vehicle in relation to the lane markings. An electric motor coupled to the steering mech- 
anism is used to provide a torque input to the steering system, which may either assist or oppose the steering 
torque from the driver. The motor is designed to assist the driver in maintaining the position of the vehicle with 
respect to the lane markings by holding it at a set point using a biasing torque in accordance with signals from 
55 the signal processor. This simulates the effect of the lane being cambered upwards towards the lane edges, 
defined by the lane markings. However the driver is able to over-ride or cancel the effect if the steering torque 
applied to the steering system by the driver exceeds a predetermined torque threshold. 

The driver has ultimate control over the vehicle and can over-ride the bias force by virtue of steering wheel 
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torque sensor inputs. The system supplements the existing power steering mechanism whilst also providing 
a failure back-up in the event of engine stall or pump drive belt failure. 

Preferably the electric motor is coupled to the steering mechanism through a gearbox and, possibly also, 
a clutch. A torque sensor positioned between the steering wheel and the electric motor is adapted to detect 
5 the steering effort provided by the driver. The torque sensor typically comprises a compliant element in the 
steering column shaft whose angle and direction of twist are measured either optically or inductively. 

Other methods of torque sensing are possible. 

The driver assistance system can also be used as a back-up to the conventional power assisted steering 
system so that some steering assistance is still available in the event of engine failure, failure of the belt drive 
10 to the power steering pump, or other problem. Alternatively, the driver assistance system could be provided 
as a part of an EPAS (electronic power assisted steering) unit with similar back-up provisions in case of emer- 
gency. As a further alternative the system could be provided as a unit added to steering systems previously 
having no power assisted steering. 

In use our invention acts as a lane support system to provide greater comfort to the driver, improved steer- 
15 ing stability, and safety. 

A method of collision avoidance for a vehicle comprising: 

a) monitoring the surroundings of the vehicle for threatening obstacles, 

b) permitting lateral movement of the vehicle if no threatening obstacles are detected by monitoring, 

c) inhibiting or deterring lateral movement of the vehicle if threatening obstacles are detected by monitoring. 
20 In this way lateral movement of the vehicle from, for example, one lane on a road to another, is only per- 
mitted where space for the movement is safely available. Threatening obstacles may be other vehicles which 
are or are likely to intrude in the space required for the lateral movement due to the respective vehicles ve- 
locities, or they may be immobile objects such as barriers, wreckages, or the like, or even particular patterns 
of markings on the road surface, such as the double lines commonly signifying no overtaking. 

25 If desired the system may be overridden by the vehicles driver. The override may consist of ignoring the 

warning or applying sufficient torque to overcome the steering bias applied by the system. 

—Preferably the lateral movement comprises movement from a position in which the vehicle tracks a first 
contrived centre line between lane markings of a road and a position where he vehicle tracks a second con- 
trived centre line between lane markings defining another lane of a road. Most preferably the second contrive 
30 centre line is a lane adjacent to that of the first contrived centre line. 

In this way a safe method for changing lanes on a road can be provided, or even for leaving or joining a 
road by means of a slip road. In such circumstances the system may even extend to velocity control to provide 
a safe envelope into which the vehicle can move.. 

The means for deterring lateral movement may comprise any one or more of an audible or visual warning 
35 to the driver of the vehicle, a vibration applied to the steering system, or a steering bias applied to the steering 
system to resist any torque applied so as to cause the undesired lateral movement, such as may be applied 
by the driver. 

In a particularly preferred form the lateral movement is sought automatically in response to the driver in- 
dicating a desire to move laterally, such as by activating the vehicles directional indicators or other user/system 
40 interface. The system may apply a steering bias so as to maintain the current lateral position if an obstacle is 
detected or may apply a steering bias so as to affect the lateral movement if no threatening obstacle is detected. 
Such a system may affect a lane change as soon as possible, after its request, delaying the change for as 
long as necessary to ensure safe movement 

The monitoring may be restricted to the side and rear of a vehicle and is preferably restricted to the road's 
45 lanes. 

Monitoring may be continuous or may be activated upon requires or indication of a lane change, or by ap- 
proach to the edge of a lane. 

Electromagnetic wave, eg visual, radar, or other forms of monitoring may be used. 
Apparatus for avoiding vehicular collision, comprising: 
50 a) monitoring means on a vehicle for detecting threatening obstacles in the vicinity of the vehicle, 

b) lateral movement means for seeking to affect lateral movement of the vehicle, 

c) means responsive to signals from monitoring means to deter lateral movement of the vehicle. 
Some embodiments of our invention are illustrated in the accompanying drawings in which:- 
Figure 1 is a layout of one embodiment of lane support system in accordance with our invention; 

55 Figure 2 is a diagrammatic representation of the effect, in use, of the lane support system of Figure 1 ; 

Figure 3 is a block diagram showing the inter-relationships between the components of the system; 
Figure 4 shows a typical autonomous intelligent cruise control (AICC) for use in the system of Figure 1; 
Figure 5 is a flow chart of the operational features of the system of Figure 1; 
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Figure 6 is a diagram of the virtual road camber induced by the lane support system; 
Figure 7 shows the effect of manual lane change; 
Figure 8 shows the effect of automatic lane change; 
Figure 9 shows raw image and processed data. 
5 Figure 1 0 shows the variables used in the lane guidance calculations; 

Figure 11 shows the various states and interrelationship for a system; and 
Figure 12 is a block diagram of a lane guidance control strategy. 

The lane support system illustrated in the layout of Figure 1 is adapted for use with a conventional steering 
system 1 of a vehicle. As illustrated the conventional steering system comprises a steering rack 2 for controlling 

10 the steering position of the front wheels of a vehicle in response to manual operation of a steering wheel 3. 
An electrically operated motor 4 is adapted to provide servo or power assistance to augment the steering effort 
applied to the rack 2 from the steering wheel 3 in response to an energising current from an electronic control 
unit 5, in turn responsive to signals from a torque sensor 6, such as disclosed in EP 0 555 987, comprising a 
compliant element in the shaft of the steering column 7 whose angle and direction of twist are measured either 

15 optically or inductively. The electric motor 4 is coupled to the steering mechanism through a gearbox 8 and a 
clutch 9 which may be omitted from certain installations. 

The vehicle is provided with a video camera 10 which is mounted on the vehicle, for example in the middle 
of the bonnet or grille, or in the vicinity of the internal rear-view mirror in order to detect the presence of lane 
markings on a road, for example the spaced white or yellow lines defining a lane of a motorway. The video 

20 camera 10 may be "light-sensitive" or of the "infra-red" sensing type. Such systems are disclosed in a technical 
paper presented to the IEE in October 1 992 entitled "Imposed Obstacle Detection By Sensor Fusion". A signal 
image processor 11, In response to signals from the video camera 10, estimates the lateral position of the ve- 
hicle in relation to the lane markings. Corresponding signals from the signal processor 11 are fed into the elec- 
tronic control unit 5 which is then operative to energise the motor 4 to apply a torque to the steering shaft to 

25 independently assist the driver in maintaining the position of the vehicle with respect to the lane markings by 
holding it at a set point by the development of an appropriate biasing torque. This simulates the effect of the 
lane being cambered, as shown in Figure 2 of the drawings, upwards towards the lane edges, defined by the 
lane markings. 

The electronic control unit 5 also receives signals from, and transmits signals to, a driver interface 12 il- 
30 lustrated in Figure 4 of the accompanying drawings which includes a LCD display 13 and an actuation switch 
14. 

The electronic control unit 5 also receives a signal from a road speed sensor 16. 

The interrelationship between the components of the system is illustrated in Figure 3 of the drawings. In 
its simplest form the video image 22 is used to detect lane markings as represented by block 20 and those 

35 detected signals control the motor 4, which in turn controls actuators 21 for operating the steering rack 2. In 
addition the video image is utilised with detector means 23 for detecting the visual time to impact and target 
status so that all targets can be tracked as represented by block 24 in accordance with the road geometry as 
represented by block 25, for example discontinuous or disabled lane markings. 

The electronic control unit 5 responds to signals from the image processor 11 and produces signals of 

40 greater or lesser magnitude to provide, in turn, a greater or smaller bias to the steering system depending upon 
the displacement of the vehicle from its contrived center line position. This is equivalent to the camber effect 
described above, but with the addition, as the vehicle approaches a lane boundary, of inducing an artificial 
rumble strip 15, as shown in Figure 2 to induce or apply a feeling of vibration to the steering wheel, thereby 
alerting the driver to the proximity of the lane marking. The frequency of the vibration may be proportional to 

45 the vehicles velocity. 

The steering bias applies by the lane support system can be switched on and off by the use of the switch 
1 4 on the driver interface. In addition the system is automatically disabled temporarily when a direction indicator 
is operated to indicate that the vehicle is moving out of the lane, for example to overtake a vehicle in front. 
This manual lane change, for example to the left is illustrated in Figure 7 with the removal of the artificial camber 

50 to the left of the vehicle. 

The operation steps and sequence of operations are set out in the flow chart of Figure 5 of the accompa- 
nying drawings. 

As illustrated in Figure 5 the system is first switched on by operation of the switch 14 the display 13 indi- 
cates that this has occurred. The system then searches the lane markings. Whilst it is doing this the message 
55 on the display 13 reads "searching". As soon as the system locates the lane markings the display 13 displays 
"accept", rf the lane marking is lost the display 13 returns "searching" until it again locates the marking with 
the display 1 3 returning to "accept". As soon as the "accept" message appears the driver then presses "accept" 
button to activate the lane support system. The message "following" is displayed on the display 1 3. The system 
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then checks the location of the vehicle by following the contrived centre line and applies a light bias to the 
steering in order to resist any movement away from the centre line position. By turning the steering wheel the 
driver can resist the bias, but the bias to be resisted increases as the vehicle approaches the lane markings. 
This provides a sensation of a "feeling" of road camber with the steering bias increasing in accordance with 
5 the steepness of the camber. 

Should the driver release the steering wheel, the steering bias will automatically return the vehicle back 
onto the contrived centre line position. 

Should the driver resist bias and move closer to the actual lane boundary itself a vibration from an artifi- 
cially created rumble strip will be felt at the steering wheel. In addition audio messages may be issued as the 
10 vehicle crosses a lane marking by utilising the conventional audio system of the vehicle. The conventional audio 
system may be inhibited during infringement signal simulation or it may be blended with the conventional audio 
signal output. 

At any time the driver can cancel the lane support system by operating the switch. In any case the system 
is disabled automatically, or may even be switched off, when the driver drives through a lane or, as described 
is above, the camber resistance is cancelled in one direction when the traffic indicator for movement of the car 
in that direction is operated. 

The system can simply be switched off or can be placed in the "actuate" mode in which it will be switched 
off automatically under the conditions described above. 

The lane support system is disabled if lane markings are lost and the interface returns to displaying the 
20 "searching" mode, issuing an audible signal to indicate that "search" is taking place. 

In a modification the system can be adapted continuously to monitor the outside and/or inside lane, as 
required, and indicate to the driver when it is clear to change lanes. If it is clear then the car will automatically 
change lane when the driver presses a lane change button, A or B in Figure 8, or otherwise activates the system 
and direction indicators may be automatically activated. The steering will feel like the camber on a banked bend 
25 as the car changes lane and as illustrated in Figure 8. Driver override is the same as before. 

This modification would reduce driver stress during lane changing, and achieve greater safety and con- 
venience. 

Monitoring of the outside and inside lane can also be used to maintain the artificially created camber, even 
after the driver signals and would, therefore, normally disable it, if the desired lane is not clear. Alternatively 

30 or additionally the driver may be warned by either steering or audio feedback of the danger. Adetection system 
of the type used in the forward view could be utilised, for instance a Doppler effect microwave radar device. 

The use of haptic feedback in the steering wheel is considered more effective than audible warnings al- 
though, as described above, audible warnings may also be used alternatively or additionally. The system pro- 
vides position related assistance/resistance in the steering to give an artificial feel of road camber of either 

35 side of the lane defined between the two lines. The driver is still expected to steer the vehicle, but experiences 
the sensation of driving along "the bottom of a bath tub". The system is deactivated by either the use of the 
indicators or by the driver exceeding the torque-motion input threshold of the steering wheel. 

The provision of the clutch 9 has the advantage of improving the feel by disengaging the motor 4 when no 
lane support assistance is required. 

40 The video based support system is adapted to detect vehicles and lane markings up to a distance of 60 

metres. The low lane image processing acquires images from the miniature CCD camera situated by the in- 
ternal rear view mirror. Edges are extracted using a dual Sobel convolution mask and intelligent thresholding. 
The edges are then thinned using Morphological techniques as shown in Figure 9 of the accompanying draw- 
ings. The thin edges in the image are then traced by fitting straight lines to them and turn into line vectors, 

45 which are then categorised on the basis of angle. The horizontal lines are used by car detection algorithm, and 
some of the non-horizontal by lane marking detection algorithm. A rear-end car filter locates cars in the image 
played by processing the horizontal line patterns. Classification of cars and the calculation of angle are good. 
Ranges estimated from the road to camber geometry by assuming a flat earth. 

The operation, interrelationship and calculations involved in a particular embodiment are provided below 

50 using the following glossary of abbreviations. 



ABS 


Anti-lock braking system 


AICC 


Autonomous intelligent cruise control 


CAN 


Car area network 


ECU 


Electronic control unit 


EPAS 


Electric power assisted steering 


HyPAS 


Hydraulic power assisted steering 


ICAS 


Intelligent collision avoidance system 


IDS 


Intelligent driver support 
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IDS rack Unit containing lane marking detection electronics 
LSB Least significant byte 

LIMIT Saturation of limiting function 

MIL Malfunction indicator lamp 

5 MMI Man machine interface 

MSN Most significant nibble 

SLEWLIM Slew limiting function (time dependent) 
TBD To be determined 

X "Dont care" (for logical states) 

10 and the following definitions 

. A positive steering torque shall be one that acts to turn the steering wheel clockwise. 
. A positive steering velocity shall correspond to a clockwise motion of the steering wheel. 
. The lateral direction shall be positive on moving to the right and negative on moving to the left with the 
vehicle moving forwards. 

is . The rack ration is defined as the angular displacement of the steering wheel divided by the angular dis- 

placement of the road wheels around the straight ahead position. 
A number of parameters must be determined in any such system their manner and interrelationship being 
as follows:- 

20 Vehicle speed sensors 

There is no direct connection between the vehicle speed sensors and the EPAS ECU. Instead, the vehicle 
speed is measured by the ABS sensors and the measurement is sent out on the CAN bus. 

25 Steering column position sensor 

An absolute steering column position measurement is provided by a potentiometer on the column and is 
connected to the EPAS ECU. This signal will be termed the "column position pot reading". 

30 Controller input signals 

Calculation of lateral position error 



35 



The lateral position error 100 is defined to be the difference between the lateral position of the centre of 
the car 101 and the lateral position of the centre of the lane 102. The error should be positive when a positive 
change in the steering angle is required to correct the error, i.e. when the car is to the left of the centre of the 
lane, the error should be positive. 

This signal is provided by the IDS rack. 

40 Calculation of rate of change of lateral position error 

The rate of change of lateral position error should be calculated using the difference between the last two 
available samples of lateral position error that were received from the IDS rack. The rate of change should be 
positive when the lateral position error is increasing. 
45 Initially the signal will not be used. 

Calculation of curvature 



50 



The "curvature" is defined to be reciprocal of the "local" radius 103 of a corner, i.e. 



curvature 1 



local radius 

Thus when the road is straight, the radius 1 03 will be infinite and the curvature will be zero; when the radius 
103 is 100m, the curvature will be 0.01m-i or 10km-i. The local radius 103 is estimated from the IDS rack in- 
formation. 

55 if the curvature signal is not valid, then the curvature should be set to zero. 

This signal is provided by the IDS rack. 
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Calculation of heading 

The heading is defined as the angle 104 between the cars longitudinal axis 105 and the tangent to the 
lane direction 106, as shown in Figure 10. The heading should be zero when the car is travelling parallel to 
5 the centre of the lane 107. The heading should be positive when the car is heading to the right of the tangent 
to the lane direction. 

This signal is provided by the IDS rack. 

Calculation of lane width 

10 

The lane width 108 is the distance between the 2 lane boundaries 109 measured the by IDS rack. The 
lane width should always be greater or equal to zero. 
This signal is provided by the IDS rack. 

15 Calculation of steer angle 

The steer angle should be calculated using a combination of the EPAS column position measurement and 
the measurement from the column position potentiometer. 

The EPAS column position measurement should be calculated in the standard manner to give: 
20 EPAS steer angle estimate = f(EPAS column position, EPAS steer angle centre, time) 

The column position potentiometer should be used to obtain a value of absolute column position. To this 
value an offset should be added which represents how many turns the steering wheel has made to the left or 
to the right. The column position pot reading should be scaled to have the same units as the EPAS column 
position measurement. 

25 pot steer angle estimate = column position pot reading + column position pot turn size x number of turns 

-column position pot zero offset 
The number of turns should be incremented every time the column position potentiometer wiper reaches 
the end of its track when the column is turning clockwise. The number of turns should be decremented every 
time the column position potentiometer wiper reaches the end of its track when the column is turning anti- 
30 clockwise. 

At power-up, a "steer angle valid" flag should be set to false. The estimate of the steering wheel turn num- 
ber should be set to zero when the following conditions both hold 

. the magnitude of the column torque is less than the column torque rack centre threshold 
. the vehicle speed is above the vehicle speed rack centre threshold 
35 . the magnitude of the heading is less than the heading rack centre threshold (and the "lane markings 

are valid") 

The "steer angle valid" flag can then be set to true and the steer angle can be set using the following pro- 
cedure. 

use pot steer angle = column position pot reading - column position pot zero offset 
40 then EPAS steer angle centre = EPAS column position - pot steer angle 

The steer angle is then calculated from the average of the EPAS steer angle estimate and the column pos- 
ition sensor estimate, i.e. 

steer angle = V2 (pot steer angle estimate + EPAS steer angle estimate) 
If the magnitude of the difference between the 2 estimates is greater than a give threshold, then the "steer 
45 angle valid" flag should be set to false. 



Specification 


Units 


column position pot turn size 


bits 


column position pot zero offset 


bits 


column torque rack centre threshold 


Nm 


vehicle speed rack centre threshold 


kph 


steer angle error threshold 


degrees 
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Calculation of the steering torque difference 

The steering torque difference is the difference between the guiding torque and the driver torque measured 
by the EPAS column sensor. 
5 steering torque difference = guiding torque - EPAS column torque 

The difference is used for diagnostics and for the lane support controller operating logic. 

Transfer between the states 

10 It is important that the change in torque is as smooth as possible when transferring between the states 

under normal operation. When a fault condition occurs, the lane support control should be turned off and the 
EPAS system should be shut-down as in the failure level 3. which requires servicing of the EPAS system before 
it can be activated again 

The guidance torque demand shall be passed through a limiter which is ramped between 0 and the max- 
15 imum guidance torque magnitude in the time specified below. 





Initial state 


Final state 


Guidance torque change 


B 


EPAS on 


guiding 


ramp up limit to maximum in 1 sec 


C 


guiding 


EPAS on 


ramp down limit to zero in 1 sec 


D 


guiding 


suspended 


ramp down limit to zero in 1 sec 


E 


suspended 


guiding 


ramp up limit to maximum in 1 sec 


F 


suspended 


EPAS on 


guidance torque should be zero 


G 


EPAS on, guiding, suspended 


EPAS disengaged 


fast change to zero guidance torque 


H 


EPAS disengaged 


EPAS on 


guidance torque should be zero 



30 

The letters B to H in the table indicate the state transitions as shown in Figure 11. The conditions for each 
state transition to occur are described below. 

Intermediate conditions 

35 

To simplify the description of the transitions between the states, some intermediate signals shall be spe- 
cified. 

The "ready for engagement" condition shall be true when all of the following conditions hold 

. the magnitude of driver torque is less than an engagement threshold 
40 . the magnitude of curvature is lower than a given threshold - i.e. road is "straight" 

. the magnitude of heading angle is lower than a given threshold - i.e. car is "straight" 

. the magnitude of steer angle is less than an engagement threshold 

. the magnitude of steering column velocity is less than an engagement threshold 

. the lane width is greater than an engagement threshold 
45 . the magnitude of the lateral position error is less than an engagement threshold 



50 



55 
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Specification 


Units 


driver torque engagement threshold 


Nm 


road curvature engagement threshold 


m-i 


heading angle engagement threshold 


degrees 


steering angle engagement threshold 


degrees 


column velocity engagement threshold 


rev/s 


minimum lane width engagement threshold 


m 


lateral position error engagement threshold 


m 



15 



20 



25 



30 



35 



The "force lane support off condition shall be true when any of the following conditions hold 
. the magnitude of driver torque exceeds the driver torque disengagement threshold 
. the curvature of a corner is greater than a disengagement threshold 
. the heading angle is greater than a disengagement threshold 
. the magnitude of steer angle exceed a disengagement threshold 
. the magnitude of the column velocity exceeds a threshold 
. the lane width is less than a disengagement threshold 

. the magnitude of the steering torque difference exceeds the torque difference disengagement threshold 



Specification 


Units 


driver torque disengagement threshold 


Nm 


road curvature disengagement threshold 


m- 1 


heading angle disengagement threshold 


degrees 


steering angle disengagement threshold 


degrees 


column velocity disengagement threshold 


rev/s 


minimum lane width disengagement threshold 


m 


torque difference disengagement threshold 


Nm 



The "lane support data is valid" condition shall be true when all of the following conditions hold 
. the lane marking information is valid 
40 . the steer angle is valid 

. the vehicle speed is valid 

. the CAN interface is active - i.e. there is no "CAN message fault" 



45 



50 



Entry to EPAS on state (transition A) 

The following conditions must all hold before the system can enter the EPAS on state, 200 
. the EPAS system must pass ail of its internal diagnostics to check its correct operation and be in the 

"normal operation" state 
. the vehicle must be stationary 

Transition from EPAS on state to guiding state (transition B) 



All of the following conditions must hold before the system can enter the guiding state 201 , 
. "lane support on" signal is true 
55 . all turn signals are off 

. the "ready for engagement" condition must be true 
. the "lane support data is valid" condition must be true 



9 



BNSDOCID: <EP_ 



^p'Gct from 105 7 SI 10 on 02/0 1 /* 



_0€40903A1_L> 



EP 0 640 903 A1 

Transition from guiding state to EPAS on state (transition C) 

If any of the following conditions occur, the system should revert to the EPAS on state 200, 
. a lane marking is crossed 
5 . the "lane support on" signal goes false 

. the "lane support data is valid" condition goes false 
. the "force lane support off condition goes true 

Transitions to and from the suspended state (transitions D, E and F) 
10 ~ " 

The lane support can be suspended temporarily under the conditions given below. 
When in guidance state switch to the suspended state 202 if 
. the "turn signal is on" signal is set 

When the suspended state 202, resume lane support (i.e. switch to the guiding state) if all of the following 
15 conditions hold 

. the turn signal is turned off 

. the "ready for engagement" condition must be true 

When in the suspended state 202, exit to the EPAS on state 200 if all of the following conditions apply 
. the time in the suspended state exceeds the maximum 
20 . the "lane support on" signal goes false 

. the "lane support data is valid" condition goes false 
. the "force lane support off" condition goes true 



Specification 


Units 


maximum time in suspended state 


s 



Transition to and from the EPAS disengaged state (transitions G and H) 

30 

If any of the following conditions occur, the system should move to the EPAS disengaged state 203: 
. disengage EPAS flag is set true by monitor program 

The lane support controller should switch from the EPAS disengaged to the EPAS on state if all of the 
following conditions apply: 
35 . disengage EPAS flag is set false by monitor program 

Exit from normal operation 

The standard exit from normal operation 204 that are defined in the EPAS Functional Specification should 
40 be maintained (for example, when the ignition is turned off). 

When any of the lane support diagnostics signal a fault, the system should be shut-down to the EPAS fault 
level 3 that is EPAS is disabled until the system is services. The driver should be warned when such a shut- 
down occurs as discussed below. 

The manner in which the guidance torque is removed is preferably fast, although smooth removal could 
45 be provided for. 
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Specification 


Units 


lane position error engagement threshold 


m 


lane position error resume threshold 


m 


minimum width threshold 


m 


driver torque engagement threshold 


Nm 


driver torque disengagement threshold 


Nm 


torque difference disengagement threshold 


Nm 


column velocity disengagement threshold 


rev/s 


column velocity engagement threshold 


rev/s 


road curvature engagement threshold 


m-1 


road curvature disengagement threshold 


m-i 


heading angle engagement threshold 


degrees 


heading angle disengagement threshold 


degrees 


guidance time-out interval 


s 


maximum time in suspended state 


s 


maximum steering angle threshold 


degrees 



Control algorithm 

The control strategy takes the lane position information from the IDS rack and combines it with the vehicle 
speed to produce an estimate of desired steering wheel position. The error between the desired steering wheel 
position and the actual steering wheel position is passed through a proportional gain and a limit to produce a 
guidance torque demand. 

A block diagram of the controller is shown in Figure 12. The controller is formed from a number of loops. 
The innermost loop is the steering angle control loop 300. This loop takes a limited steer angle demand 301 
and calculates a steer angle error 308 using the measured steering angle 302. The error is then passed through 
the steer angle gain 303 to give a guidance torque demand 309. The guidance torque demand 309 is limited 
304 and slew rate limited 305 before being sent to augment the ERAS control torque 306. The limits on guidance 
torque demand 309 and on steer angle demand 301 are varied with vehicle speed. The slew rate limit output 
should be set to zero whenever the guiding state is entered. 

steer angle error = LIMIT(steer angle demand) - steer angle 

guidance torque demand = SLEWLIM(L1MIT(steer angle gain x steer angle error)) 
The second loop 310 controls the heading angle. The heading demand 311 is limited 312. The heading 
error 313 is calculated from the difference of the limited heading demand 312 and the measured heading 314. 
The difference is passed through 2 gains. The first gain is the vehicle factor 31 5. The second gain is the heading 
gain 316. The heading gain 316 converts the error into the steer angle demand 317. The vehicle factor is a 
single constant that is calibrated from 3 vehicle-dependent parameters: rack ratio, wheel base length and un- 
dersteer factor. 

heading error = LIMIT (heading demand) - heading 

steer angle demand = heading error x heading gain x vehicle factor 

vehicle factor = rack ratio x wheel base/understeer factor 
The outer loop 320 controls the lateral position. The lateral position error 321 is first multiplied by the re- 
ciprocal of vehicle speed to give a "normalised'' position correction heading 322. The position correction head- 
ing is added to the limited curve balance feedforward 323 to give the heading demand 311. 

position correction heading = lateral position error x reciprocal vehicle speed 

heading demand = position correction heading + curve balance feedforward 

11 
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The vehicle speed reciprocal calculation should only occur at speeds above 40 kph. At speeds below this, 
the vehicle speed reciprocal should be set to 1/40 kph- 1 to prevent the algorithm dividing by zero, 
vehicle speed reciprocal = 1/LIMIT (vehicle speed) 
The curve balance feedforward 323 referred to above is calculated from the produce of the curvature 
5 measurement 324 and the vehicle speed 325. This product is passed through the curve balance gain 326 and 
then limited 327 to give the curve balance feedforward. NB the curve balance heading limit 323 will give to 
be set to zero if the curvature measurement 324 is not available. 

curve balance heading = LIMIT (curvature x vehicle speed x curve correction gain) 
The limits on guidance torque demand and on steer angle demands are determined by ranges relating to 
w vehicle speed. 

Automatic lane change 

The automatic lane change function senses the turn signal to change lane and uses a blind spot monitor 
15 (TBD) to establish whether the lane is clear for the car to move into. If the lane is clear, a guidance torque is 
applied to move the car to an adjacent lane using information from the lane marking sensor to steer the vehicle 
smoothly. 

Given the various safety considerations as much of the system as possible is subject to be initiation and 
continuing diagnostic checks. In the event of a problem or irregularity being detected a warning may be given, 
20 or the system may temporarily shut down. 

Driver warnings 

There are 2 means for warning the driver, by means of the warning control 330, of events recognised or 
25 initiated by the system. The first is by "shaking the stick" (=steering wheel) 331 and the second is to issue an 
audible warning 332 to the driver. 

Haptic feedback signal 

30 The driver may be warned by a deliberate vibration of the steering wheel. This function shall be termed 

haptic feedback. 

The haptic feedback will consist of a symmetric triangle wave which will be added to the guidance torque 
demand. The amplitude and frequency of the vibration shall be fixed. 



Specification 


Units 


Haptic feedback frequency 


Hz 


Haptic feedback amplitude 


Nm pk-pk 


Haptic feedback duration 


second 



Audible warning signal 

A message shall be sent to the MMI controller, requesting a driver warning. NB this may change - the IDS 
rack may be used to give a number of different audible warnings. 

Warnings 

The warnings are described in the following sections. The table below gives the full list of warnings, to- 
gether with the operating modes in which they should be issued. The warnings should be repeated at the given 
rate for as long as the condition is true. In the case of the lane marking warnings, the lane markings must be 
valid. The warnings arise as a result of a number of inputs to the warning control, these being velocity 333, 
lane width 334, lateral position error 335, lane moulding threshold 336 and car width 337. 
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Warning 


Lane support state 


Warning means 


Warning repetition rate 


Close to lane marking 


guiding only 


Haptic feedback 


once every 3 seconds 


Very close to lane 
marking 


guiding only 


Haptic feedback 


once every second 


Crossing solid lane 
marking 


any except disengaged 


Haptic feedback 


once only 


Lane support disen- 
gaged 


disengaged 


Audible signal 


once only 


Shut-down 


any 


Audible signal 


twice 



15 

Close to lane marking 



20 



25 



30 



35 



This is given by the following condition 

V2 (lane width - car width) - lateral position error magnitude < lane marking close threshold 
The warning should be disabled when the width of the lane is small, i.e. when 

lane width - car width < narrow lane threshold 
The narrow lane condition may not be invoked if the control logic condition on lane width is breached before 
the narrow lane threshold. 



Specification 


Units 


lane marking close threshold 


m 


narrow lane threshold 


m 



Very close to lane marking 

This condition holds when 

Vi (lane width - car width) - lateral position error magnitude < lane marking crossed threshold 
The warning should be disabled when the width of the lane is small as above. 



40 



Specification 


Units 


lane marking very close threshold 


m 



45 



SO 



Crossing solid lane marking 

This is similar to the "close to lane marking condition" and is given by the following condition. 

V2 (lane width - car width) - lateral position error magnitude < lane marking crossing threshold 
The warning should be disabled when the width of the lane is small as above. The warning should only 
occur when the vehicle speed is greater than the given value. 



Specification 


Units 


lane marking very close threshold 


m 


minimum vehicle speed 


kph 



55 



Lane support disengaged 

When the lane support control is disengaged for any reason a warning should be issued. 
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Claims 

1. A method of tracking a contrived centre line between lane markings of a road characterised in that a steer- 
ing bias is applied to the steering system of the vehicle in such a manner as to assist the driver in tracking 

5 the contrived centre line position. 

2. A method according to claim 1 characterised in that the level of steering bias applied to the steering system 
is relatively small when the track of the vehicle is in proximity to the contrived centre line and the steering 
bias is adapted to be increased as the vehicle approaches the boundaries defined by the line markings. 

10 

3. A method according to any preceding claim characterised in that a steering torque ripple is applied by the 
steering system as the vehicle approaches a lane boundary. 



15 



4. A method according to any preceding claim characterised in that an audio signal is produced to alert the 
driver of a possible lane boundary infringement. 

5. A method according to claim 4 characterised in that the conventional audio system of the vehicle is utilised 
to produce the simulated infringement signal. 

6. A method according to any preceding claim characterised in that if the lane marking signals are lost, a 
20 warning is issued to the driver and the system is disabled. 

7. A method according to any preceding claim characterised in that the system incorporates means for can- 
celling the signal bias when a direction indicator of the vehicle is actuated. 

25 8. Apparatus for maintaining the position of the vehicle with respect to the lane markings characterised in 
that lane markings are detected by the use of a video camera or equivalent sensor mounted on the vehicle 
which is "light sensitive" or of the "infra-red" sensing type, an associated signal processor estimates the 
lateral position of the vehicle in relation to the lane markings, an electric motor coupled to the steering 
mechanism is used to provide a torque input to the steering system. 

30 

9. Apparatus according to claim 8 characterised in that the driver is able to override or cancel the effect if 
the steering torque applied to the steering system by the driver exceeds a predetermined torque threshold. 



35 



10. Apparatus according to claim 8 or claim 9 characterised in that the system supplements the existing power 
steering mechanism whilst also providing a failure back-up in the event of engine stall or pump drive failure. 



40 
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50 



55 
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LANE SUPPORT CONTROLLER 



SYSTEM SWITCHED ON 



LANE MARKINGS LOST 
DISPLAY "SEARCHING" 
MESSAGE RE-INITIALISE 
TRACKER DISABLE LANE 
SUPPORT WARN DRIVER 



SEARCHING FOR 
LANE MARKINGS 



LANE MARKINGS LOST 
DISPIAY "SEARCHING- 
MESSAGE 

RE-INITIALISE TRACKER 



VALID LANE MARKINGS FOUND 
ENABLE LANE TRACKING 
DISPLAY DRIVER "ACCEPT 
MESSAGE 



WAITING FOR DRIVER 
TO ACTIVATE LANE 
SUPPORT 



DRIVER CANCELS LANE 
SUPPORT 

DISABLE LANE SUPPORT 
DISPLAY DRIVER "ACCEPT 
MESSAGE 



FOLLOWING LANE 
CENTRE LINE 
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ENABLE CENTRE LINE 
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STEEP STEERING REACTION 



FEELING OF ROAD 
CAMBER 
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DISABLE LANE SUPPORT 
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DRIVER PRESSES ACCEPT 
ENABLE CENTRE LINE 
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DRIVER "FOLLOWING" 
MESSAGE 
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ENABLE STEEP STEERING 
REACTION 
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ENABLE WHEEL VIBRATION 
ENABLE AUDIO RUMBLE & 
CATS EYE SOUND 



Fig.5 
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